Method, system, and apparatus for generating and training a digital signal processor for evaluating graph data

ABSTRACT

Embodiments of the present disclosure provide methods, systems, apparatuses, and computer program products for generating, training, and utilizing a digital signal processor (DSP) to evaluate graph data that may include irregular grid graph data. An example DSP that may be generated, trained, and used may include a set of hidden layers, wherein each hidden layer of the set of hidden layers comprises a set of heterogeneous kernels (HKs), and wherein each HK of the set of HKs includes a corresponding set of filters selected from the constructed set of filters and associated with one or more initial Laplacian operators and corresponding initial filter parameters.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Non-Provisional applicationSer. No. 16/052,936, entitled “Method, System, And Apparatus ForGenerating And Training A Digital Signal Processor For Evaluating GraphData,” and filed Aug. 2, 2018, the entire contents of which are herebyincorporated by reference.

TECHNOLOGICAL FIELD

Embodiments of the present invention generally relate to generating andtraining a digital signal processor (DSP) for the evaluation of graphdata.

BACKGROUND

Various tools have historically been used to model grid datasets.Applicant has identified a number of deficiencies and problemsassociated with these tools. Through applied effort, ingenuity, andinnovation, many of these identified problems have been solved bydeveloping solutions that are included in embodiments of the presentdisclosure, many examples of which are described in detail herein.

SUMMARY

Although various tools have historically been used to model grid datasets, some problems may only be modeled by irregular grids, for which atraditional CNN model is not be able to provide accurate predictiveresults. Embodiments described herein set forth DSP machine learningmodels for use with graph data, including graph data comprisingirregular grid datasets. Example embodiments described herein includes aDSP having a self-learning/self-trainable feature that may be optimizedover time by training the DSP using known graph data fed into the DSP.After an optimized DSP is generated, parameters of the optimized DSP maybe stored in a database for later retrieval to facilitate automatedpredictions in an online (or a prediction) phase using unknown graphdata.

In one example embodiment, an apparatus is provided for generating andtraining a digital signal processor (DSP) to evaluate graph data. Theapparatus includes at least one processor and at least on memoryincluding computer program code, wherein the at least one memory and thecomputer program code configured to, with the at least one processor,cause the apparatus to receive, by a processor, known graph data thatincludes irregular grid graph data, and split, by the processor, theknown graph data into a set of training graph data and a set ofcross-validation graph data. The at least one memory and the computerprogram code are further configured to, with the at least one processor,cause the apparatus to construct, by the processor, a set of filtersusing the training graph data, and formulate, by the processor, anobjective function for training. The at least one memory and thecomputer program code are further configured to, with the at least oneprocessor, cause the apparatus to generate, by the processor, anoptimized DSP using the objective function, the constructed set offilters, the training graph data and the cross-validation graph data,wherein the optimized DSP includes a set of hidden layers, wherein eachhidden layer of the set of hidden layers comprises a set ofheterogeneous kernels (HKs), and wherein each HK of the set of HKsincludes a corresponding set of filters selected from the constructedset of filters and associated with one or more initial Laplacianoperators and corresponding initial filter parameters, and save, in amemory, a set of parameters defining the optimized DSP.

In another example embodiment, a method is provided for generating andtraining a digital signal processor (DSP) to evaluate graph data. Themethod includes receiving, by a processor, known graph data thatincludes irregular grid graph data, and splitting, by the processor, theknown graph data into a set of training graph data and a set ofcross-validation graph data. The method further includes constructing,by the processor, a set of filters using the training graph data, andformulating, by the processor, an objective function for training. Themethod further includes generating, by the processor, an optimized DSPusing the objective function, the constructed set of filters, thetraining graph data, and the cross-validation graph data, wherein theoptimized DSP includes a set of hidden layers, wherein each hidden layerof the set of hidden layers comprises a set of heterogeneous kernels(HKs), and wherein each HK of the set of HKs includes a correspondingset of filters selected from the constructed set of filters andassociated with one or more initial Laplacian operators andcorresponding initial filter parameters and saving, in a memory, a setof parameters defining the optimized DSP.

In yet another example embodiment, an apparatus is provided forgenerating a predicted result using graph data and a DSP. The apparatusincludes at least one processor and at least on memory includingcomputer program code, wherein the at least one memory and the computerprogram code are configured to, with the at least one processor, causethe apparatus to receive, by a processor, unknown graph data thatincludes irregular grid graph data. The at least one memory and thecomputer program code are configured to, with the at least oneprocessor, further cause the apparatus to retrieve an optimized DSP,wherein the optimized DSP includes a set of hidden layers, wherein eachhidden layer of the set of hidden layers comprises a set ofheterogeneous kernels (HKs), and wherein each HK of the set of HKsincludes a corresponding set of filters selected from the constructedset of filters and associated with one or more initial Laplacianoperators and corresponding initial filter parameters. In addition, theat least one memory and the computer program code are configured to,with the at least one processor, further cause the apparatus togenerate, by the processor and using the optimized DSP, a predictedresult based on the unknown graph data.

In another example embodiment, a method is provided for generating apredicted result using graph data and a DSP. The method includesreceiving, by a processor, unknown graph data that includes irregulargrid graph data, and retrieving an optimized DSP, wherein the optimizedDSP includes a set of hidden layers, wherein each hidden layer of theset of hidden layers comprises a set of heterogeneous kernels (HKs), andwherein each HK of the set of HKs includes a corresponding set offilters selected from the constructed set of filters and associated withone or more initial Laplacian operators and corresponding initial filterparameters. The method also includes generating, by the processor andusing the optimized DSP, a predicted result based on the unknown graphdata.

The above summary is provided merely for purposes of summarizing someexample embodiments to provide a basic understanding of some aspects ofthe invention. Accordingly, it will be appreciated that theabove-described embodiments are merely examples and should not beconstrued to narrow the scope or spirit of the invention in any way. Itwill be appreciated that the scope of the invention encompasses manypotential embodiments in addition to those here summarized, some ofwhich will be further described below.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Having thus described the invention in general terms, reference will nowbe made to the accompanying drawings, which are not necessarily drawn toscale, and wherein:

FIG. 1 is a diagram of a system that can be used in conjunction withvarious embodiments of the present invention;

FIG. 2 is a schematic of a computing entity in accordance with certainembodiments of the present invention;

FIG. 3 is a schematic of a memory media storing a plurality ofrepositories, databases, and/or relational tables;

FIGS. 4A and 4B illustrate exemplary regular graph data that may beevaluated in accordance with example embodiments described herein;

FIG. 4C illustrates an example of irregular graph data that may beevaluated in accordance with example embodiments described herein;

FIG. 5 illustrates an exemplary DSP structure generated according to oneembodiment of the present disclosure;

FIG. 6 illustrates an exemplary flow diagram for generating and traininga DSP according to one embodiment of the present disclosure;

FIG. 7 illustrates an exemplary flow diagram for generating an optimizedDSP in an iterative manner; and

FIG. 8 illustrates an exemplary flow diagram for generating a predictedresult for graph data using an optimized DSP according to one embodimentof the present disclosure.

DETAILED DESCRIPTION OF SOME EXAMPLE EMBODIMENTS

Various embodiments of the present invention now will be described morefully hereinafter with reference to the accompanying drawings, in whichsome, but not all embodiments of the inventions are shown. Indeed, theseinventions may be embodied in many different forms and should not beconstrued as limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure will satisfy applicablelegal requirements. The term “or” (also designated as “/”) is usedherein in both the alternative and conjunctive sense, unless otherwiseindicated. The terms “illustrative” and “exemplary” are used to beexamples with no indication of quality level. Like numbers refer to likeelements throughout.

I. EXEMPLARY TERMS

As used herein, the terms “data,” “dataset,” “content,” “digitalcontent,” “digital content object,” “information,” and similar terms maybe used interchangeably to refer to data capable of being transmitted,received, and/or stored in accordance with embodiments of the presentinvention. Thus, use of any such terms should not be taken to limit thespirit and scope of embodiments of the present invention. Further, wherea computing device is described herein to receive data from anothercomputing device, it will be appreciated that the data may be receiveddirectly from the another computing device or may be received indirectlyvia one or more intermediary computing devices, such as, for example,one or more servers, relays, routers, network access points, basestations, hosts, and/or the like, sometimes referred to herein as a“network.” Similarly, where a computing device is described herein tosend data to another computing device, it will be appreciated that thedata may be sent directly to another computing device or may be sentindirectly via one or more intermediary computing devices, such as, forexample, one or more servers, relays, routers, network access points,base stations, hosts, and/or the like.

The terms “client device,” “computing entity,” “system,” may refer tocomputer hardware and/or software that is configured to access a servicemade available by a server. The server is often (but not always) onanother computer system, in which case the client device accesses theservice by way of a network. Client devices may include, withoutlimitation, smart phones, tablet computers, laptop computers, wearables,personal computers, enterprise computers, and/or the like.

The term “user” should be understood to refer to an individual, group ofindividuals, business, organization, and/or the like.

As used herein, the term “machine-learning model” refers to a computingsystem storing a set of algorithms that has been optimized through theimplementation of a training process rather than through manualmodification. In this regard, the training process may involve providingthe set of algorithms with training data, which contains a set ofrecords each having particular inputs and corresponding outputscomprising the correct “answer” for the inputs. The training process maybe an iterative process providing the inputs for a particular record tothe set of algorithms and determining whether the output of the set ofalgorithms corresponds to the known output for the particular record. Ifso, then no changes are made to the set of algorithms. If not, however,then the training process involves autonomously altering the set ofalgorithms, providing the inputs for the particular record to the set ofalgorithms again, and determining again whether the output of the set ofalgorithms corresponds to the known output for the particular record.This process may be iterated until the set of algorithms produces anoutput that corresponds to the known output for the particular record.The training process iterates through each record in the training dataeither a predetermined number of times or until an optimized version ofthe set of algorithms produces outputs for the records in the trainingdata mirroring the known outputs for those records. The resultingmachine-learning model is considered “trained” insofar as it is expectedto produce accurate predictions of outputs for new data for which thecorrect output is unknown. As used herein, a machine-learning model maybe used to predict relationships between nodes of irregular grid graphdata. More specifically, a machine learning model may be a component ofa digital signal processor (DSP) configured to analyze the irregulargraph data. In the present disclosure, a known/seen graph dataset isused as a training dataset for training the DSP. The trained DSP mayfurther be used to receive an unknown/unseen graph dataset and output aprediction regarding nodes of the unknown/unseen dataset.

The term “digital signal processor (DSP)” historically refers to aspecial-purpose processor designed for efficient use in signalprocessing and other applications requiring efficient execution ofcomplex mathematical operations. In the context of embodiments disclosedherein, the term “digital signal processor” or “DSP” may encompass suchprocessing devices, but more broadly refers to any computing systemsimplementing machine learning to analyze graph datasets. In thiscontext, a DSP may host an artificial neural network structurecomprising multiple hidden layers (such as those described below) eachcomprising multiple heterogeneous kernels (such as those describedbelow). Some example DSPs have learnable features that may be trained byfeeding the DSP known/seen dataset as input. The trained DSP may be usedlater to draw predictions regarding unknown/unseen data.

As used herein, the terms “irregular grid dataset,” “irregular gridgraph data,” and the like, refer to graph data having an irregular gridstructure. An irregular grid graph dataset comprises a set of nodesconnected by a set of edges structured such that any pair of nodes mayor may not be connected (with arbitrary weights/distances) in Euclideanspace. Irregular grid graph data comprises a subset of all graph data.As described herein, social networks, the world-wide-web,protein-interaction networks, telecommunication networks, knowledgegraphs, or any of a number of other types of real-world systems may berepresented using irregular grid graph data. However, graph dataencompasses more than just irregular grid data. Graph data may alsocomprise regular grid data, which is a special case of graph data forwhich nodes have regular connectivities. Similar to CNNs, exampleembodiments of the DSP described herein work with regular grid data,however unlike CNNs, these example embodiments also work with irregulargrid data.

As used herein, the term “hidden layer” refers to an element within aDSP whose output comprises an input to another element within the DSPrather than an output of the DSP itself. In the context of embodimentsdisclosed herein, a DSP may comprise a plurality of connected hiddenlayer. In this context, the DSP may process the received input datasetin a layer-by-layer manner.

As used herein, the term “heterogeneous kernel (HK)” refers to acomponent of a given hidden layer of a DSP. In this regard, a givenhidden layer may comprise one or a plurality of HKs. Each HK comprisesan aggregated set of filters comprising one or more of a K-orderChebyshev filter, a first-order renormalized filter, a K-order topologyadaptive filter, or any other suitable filter. The mathematicalrepresentations of a set of exemplary filters are presented in thefollowing table:

$\sum\limits_{K - 1}^{k = 0}{\theta_{k}{T_{k}\left( \overset{\sim}{\Lambda} \right)}}$K-order Chebyshev filter θ({tilde over (D)}^(-1/2)Ã{tilde over(D)}^(-1/2) l^(st)-order renormalized filter$\sum\limits_{K - 1}^{k = 0}{\theta_{k}Ã^{k}}$ K-order topology adaptivefilterwhere θ_(k) represents the k-th polynomial coefficient parametrizing thefilter and optimized for during the training, T_(k)(⋅) represents thek-th order matrix Chebyshev polynomial, {tilde over (Λ)} representsrescaled frequency {tilde over (Λ)}∈[−1, 1], A represents an adjacencymatrix of the graph, Ã=A+I is the adjacency matrix with self-connection(the identity matrix I), and D represents a diagonal matrix withdiagonal element D_(ii)=Σ_(j)A_(ij). In this context, a given HK may beconstructed by a weighted combination of different filters listed in theabove table, as illustrated below:

${y = {\sum_{m = 0}^{M - 1}{\alpha_{m}{{\hat{g}}_{\theta}^{(m)}(L)}x}}},$${{{\hat{g}}_{\theta}^{(m)}(L)} \in \left\{ {{\sum_{K - 1}^{k = 0}{\theta_{k}{T_{k}\left( \overset{\sim}{\Lambda} \right)}}},{\theta\left( {{{\overset{\sim}{D}}^{- \frac{1}{2}}\overset{\sim}{A}{\overset{\sim}{D}}^{- \frac{1}{2}}},{\sum_{K - 1}^{k = 0}{\theta_{k}{\overset{\sim}{A}}^{k}\ldots{etc}}}} \right.}} \right\}},$

where x represents input dataset, y represents output dataset, Mrepresents a total number of filters selected in the model, and α_(m)represents a learnable parameter associated with the m-th filter ĝ_(θ)^((m))(L) that is associated with the corresponding Laplacian operatorL_(m) and is selected from a filter set comprising a K-order Chebyshevfilter, a first-order renormalized filter, and a K-order topologyadaptive filter.

As used herein, the term “Laplacian operator” refers to a derivativefilter that is used to find locations of rapid changes or edges in thegraph data. In the context of embodiments disclosed herein, a filterwithin an HK may be constructed based on different Laplacian operators,such as a normalized Laplacian operator or a random walk Laplacianoperator. In this context, the normalized Laplacian operator may bedenoted as:

L=D ^(−1/2) L _(c) D ^(−1/2) =I _(N) −D ^(−1/2) AD ^(−1/2),

and the random walk Laplacian operator may be denoted as:

L=D ⁻¹ L _(c) =I _(N) −D ⁻¹ A,

where A represents an adjacency matrix of the graph, D represents adiagonal matrix with diagonal element D_(ii)=Σ_(j)A_(ij), L_(c)=D−A, andI_(N) represents an N-by-N identity matrix.

As used herein, the term “objective function” refers to a targetingfunction or a targeting goal that a machine learning model is desired tooptimize. An objective function may be a “loss function” representingsome cost associated with one or more variables that the optimizationproblem seeks to minimize by way of modification to the designed machinelearning model. An objective function may also be a “reward function”representing some profit associated with one or more variables that theoptimization problem seeks to maximize by way of the designed machinelearning model.

As used herein, the term “training dataset” refers to dataset that isused to optimize or train parameters of a machine learning model. In thecontext of machine learning, a machine learning is trained on thetraining dataset comprising pairs of an input data and the correspondinganswer data or target data. The machine learning model is used to runwith input data and produce a predictive result, which is then comparedwith the target data. Based on the result of the comparison and thedesigned learning algorithm being used, the parameters of the machinelearning model are adjusted and updated for optimizing predictiveresults.

As used herein, the term “cross-validation dataset” refers to a datasetthat is used to validate the predictive accuracy of a machine learningmodel trained using the training dataset. A cross-validation dataset maybe used to prevent overfitting to the training dataset by stopping thetraining process when the predictive accuracy of the machine learningmodel diminishes when tested on the validation dataset.

II. GENERAL OVERVIEW

Artificial intelligence has been used for analyzing problems, such asimage classification, video recognition, and text classification in avariety of contexts. More specifically, different types of machinelearning solutions have been used for these purposes. For example, forproblems that may be modeled by regular grid datasets having a featureof constant Euclidean distance and local stationary structures, aconvolutional neural network (CNN) model may provide accurate predictiveresults. However, for those problems that may only be modeled byirregular grids, a traditional CNN model is not be able to provideaccurate predictive results.

Embodiments described herein set forth DSP machine learning models foruse with graph data, including that comprising irregular grid datasets.Example embodiments described herein includes a DSP having aself-learning/self-trainable feature that may be optimized over time bytraining the DSP using known graph data fed into the DSP. The DSPcomprises a series of cascaded hidden layers, where each hidden layercomprises a weighted combination of HKs, and each HK in turn comprises aweighted combination of filters. The DSP included in example embodimentsdescribed here can be trained in an offline phase using known data inorder to optimize an objective function in an iterative manner. After anoptimized DSP is generated, parameters of the optimized DSP may bestored in a database for later retrieval to facilitate automatedpredictions in an online (or a prediction) phase using unknown graphdata.

Example DSPs disclosed herein may be optimized by modifying thedifferent filters comprising any given HK, by using different numbers ofHK for each hidden layer, and by using different numbers of hiddenlayers. Through this manner of implementation, example embodimentsdescribed herein may generate predictive results with better accuracythan traditionally used CNN models.

a. Technical Problem to be Solved

Machine learning method has been used to resolve machine learningproblems associated with digital signals that may be modeled by regulargrid graph data. For regular grid graph data, historical DSP modelingtools have been had reasonable success due to the local stationarity ofthe grid. However, for irregular grid data, traditional CNN models havenot been able to generate accurate predictive result.

Example DSPs disclosed herein overcome this technical hurdle forimplementing machine learning methods on irregular grid data. Morespecifically, example embodiments may be used to resolve machinelearning problems associated with real-world problems that are bestmodeled as irregular grids. One example of such a problem may be frauddetection, where an entity may wish to example a network of industryparticipants to identify which are potentially engaging in fraudulentactivity. Another example may be modeling a series of providers andmembers in connection with a recommendation engine problem to identifyimproved ways to identifying whether to recommend providers to any givenmember within the network. Another exemplary problem may be diseaseprediction, where an irregular grid can be used to predict the spread ofdisease throughout a network. Another exemplary problem may be provideroptimization, where an irregular grid can be used to predict anoptimized providers for providing service to members within the network.In other words, example embodiments described herein provide technicalsolutions to problems that have historically been intractable. While theabove examples are provided by way of illustration, they are intended asnon-limiting examples, and other machine learning problems best modeledusing irregular grid graphs may also be addressed using exampleembodiments described herein.

b. Technical Solution

As described above, not all data can be modeled using regular grids. Forexample, some real world data—such as social networks, telecommunicationnetworks, point clouds, and/or the like—may only suitably be representedusing irregular grids. Further, because application of kernel-basedconvolutions to irregular grids has not historically been feasible dueto the fact that irregular grid data does not have local stationarityand compositionality, historical tools are not well suited to analysisof this data.

Example embodiments described herein address those problems using aneural network designed to apply deep learning on any type of graphdata, including irregular grid data. Such example embodiments include alearnable structure comprising a plurality of different filters (ratherthan using a static arrangement of filters or simply a single type offilter) considered simultaneously in every iteration step of thetraining phase. Example embodiments described herein include a DSPhaving the feature of selecting a weighted combination of filters toform an HK, selecting a weighted combination of HKs to form a hiddenlayer, cascading a plurality of hidden layers, and self-generating anoptimized DSP at the same time by optimizing an objection function.

As illustrated by the following table, the DSPs included in exampleembodiments described herein may have a better predictive result interms of classification accuracy (in percent). From the below table, oneexample DSP generated in the manner disclosed herein (and denoted by“Proposed HK-GCN” in the first row) has a higher classification accuracywhile having a lower complexity (or lower number of filters being usedin the model) than historical tools. More specifically, three opensource irregular grid datasets are used (e.g., Citeseer, Cora, andPubmed) for comparing the efficacy of this example DSP to other CNNmodels (e.g., Kipf-GCN model, ChebNet model, DeepWalk model, andnode2vic model). The comparison shows that the Proposed HK-GCN DSPproduces a 71.2% accuracy for Citeseer dataset, 83.4% accuracy for Coradataset, 79.4 accuracy for Pubmed dataset, and for each data set, theProposed HK-GCN DSP provides the highest classification accuracy of allthe models evaluated. Further, the Proposed HK-GCN DSP has lesscomputational complexity in that it comprised 8 filters for the Citeseerdataset, 10 filters for the Cora dataset, and 6 filters for the Pubmeddataset after the objective function was optimized, demonstrating thatfewer filters were required for forming Proposed HK-GCN DSP than fortraditional CNN models.

Methods Citeseer Cora Pubmed Proposed 71.2 83.4 (10 filters) 79.4 (6filters) HK-GCN (8 filters) Kipf-GCN 70.3 81.5 (16 filters) 79.0 (16filters) [Kipf2017] (16 filters) ChebNet 69.6 81.2 (16 fiters) 74.4(16filters) [Defferard2016] (16 filters) DeepWalk 43.2 67.2 65.3[Perozzi2014] node2vec 54.7 74.9 75.3 [Grover2016]

c. Exemplary Use Contexts

The disclosed technical solution may be used to resolve and implementmachine learning solutions on real-world representations of networksmodeled by irregular grid graph data.

As a non-limiting example, irregular grid graph data may represent afraud detection network comprising a set of nodes and a set of edges,where each node represents a provider or a member and each edgeconnecting two nodes represents a relationship between the two nodes.For example, an edge connecting an insurance provider and a member mayrepresent that the member has an insurance policy from the insuranceprovider. This relationship may, in turn, affect the likelihood that theinsurance provider and the member are involved in related activity, suchthat if one of the two is involved in fraudulent activity, there is achance that the other may be as well. In this context, the known/seengraph data contains, for each of the providers and members includedtherein, data relevant to determining whether a given provider or memberis or has been involved in fraudulent activity. Thus, whenunknown/unseen graph data is presented to the machine-learning model,the machine-learning model identifies combinations of situationsrepresented in the known/seen graph data that are representative oflikely fraudulent activity, such that the system can thereafter predictwhether providers or members represented by unknown/unseen graph dataare likely also involved in fraudulent activity (specifically, thesystem generates a result indicative of the level of similarity betweennodes in the known/seen graph data associated with fraudulent activityand nodes in the unknown/unseen graph data). Following verification ofthe fraudulent (or non-fraudulent) nature of the activities performed byeach provider or member represented in the unknown/unseen graph data,the unknown/unseen graph data may be used to further train themachine-learning model for increased accuracy of future analyses.

As another non-limiting example, irregular grid graph data mayalternatively represent a recommendation engine network comprising a setof nodes and a set of edges, where each node represents a provider or amember and each edge connecting two nodes represents a relationshipbetween the two nodes. For example, an edge connecting a provider and amember may indicate that the member has purchased a product from theprovider, and this relationship may be indicative of relevantcharacteristics connecting providers and members that can inform futuresearch inquiries.

As yet another non-limiting example, irregular grid graph data mayrepresent a life sciences network (such as a disease prediction network)as a set of nodes and a set of edges, where each node represents adisease or a patient and each edge connecting two nodes represents arelationship between the patient and the disease. For example, an edgeconnecting a disease and a patient may indicate a patient has a disease,and various attributes of the disease and the patient may be indicativeof whether a similarly situated patient would be likely to contract thedisease. In this context, the known/seen graph data contains, for eachof the diseases and patients included therein, valuable informationindicative of the spread of the disease.

And as yet another non-limiting example, irregular grid graph data mayrepresent a provider optimization network using a set of nodes and a setof edges, where each node represents a provider or a member and eachedge connecting two nodes represents a relationship between the twonodes. For example, an edge connecting a health care provider and amember may indicate that a provider has treated the member, and of thevarious providers and members connected in this fashion, some of thetreatments were more effective than others. In this context, whentrained using a set of known/seen graph data identifying the connectionsbetween providers and members and the success of the various treatments,training of the DSP may enable the DSP to identify informationindicative of a likelihood that unknown members would be cured by thetreatment provided by unknown health care providers.

The above exemplary neural network problems are presented asnon-limiting examples, and other machine learning problems (e.g.,various social network problems) modeled as irregular grid graph datacan also be addressed using example DSPs described herein.

III. COMPUTER PROGRAM PRODUCTS, METHODS, AND COMPUTING ENTITIES

Embodiments of the present invention may be implemented in various ways,including as computer program products that comprise articles ofmanufacture. Such computer program products may include one or moresoftware components including, for example, software objects, methods,data structures, and/or the like. A software component may be coded inany of a variety of programming languages. An illustrative programminglanguage may be a lower-level programming language such as an assemblylanguage associated with a particular hardware architecture and/oroperating system platform. A software component comprising assemblylanguage instructions may require conversion into executable machinecode by an assembler prior to execution by the hardware architectureand/or platform. Another example programming language may be ahigher-level programming language that may be portable across multiplearchitectures. A software component comprising higher-level programminglanguage instructions may require conversion to an intermediaterepresentation by an interpreter or a compiler prior to execution.

Other examples of programming languages include, but are not limited to,a macro language, a shell or command language, a job control language, ascript language, a database query or search language, and/or a reportwriting language. In one or more example embodiments, a softwarecomponent comprising instructions in one of the foregoing examples ofprogramming languages may be executed directly by an operating system orother software component without having to be first transformed intoanother form. A software component may be stored as a file or other datastorage construct. Software components of a similar type or functionallyrelated may be stored together such as, for example, in a particulardirectory, folder, or library. Software components may be static (e.g.,pre-established or fixed) or dynamic (e.g., created or modified at thetime of execution).

A computer program product may include a non-transitorycomputer-readable storage medium storing applications, programs, programmodules, scripts, source code, program code, object code, byte code,compiled code, interpreted code, machine code, executable instructions,and/or the like (also referred to herein as executable instructions,instructions for execution, computer program products, program code,and/or similar terms used herein interchangeably). Such non-transitorycomputer-readable storage media include all computer-readable media(including volatile and non-volatile media).

In one embodiment, a non-volatile computer-readable storage medium mayinclude a floppy disk, flexible disk, hard disk, solid-state storage(SSS) (e.g., a solid state drive (SSD), solid state card (SSC), solidstate module (SSM), enterprise flash drive, magnetic tape, or any othernon-transitory magnetic medium, and/or the like. A non-volatilecomputer-readable storage medium may also include a punch card, papertape, optical mark sheet (or any other physical medium with patterns ofholes or other optically recognizable indicia), compact disc read onlymemory (CD-ROM), compact disc-rewritable (CD-RW), digital versatile disc(DVD), Blu-ray disc (BD), any other non-transitory optical medium,and/or the like. Such a non-volatile computer-readable storage mediummay also include read-only memory (ROM), programmable read-only memory(PROM), erasable programmable read-only memory (EPROM), electricallyerasable programmable read-only memory (EEPROM), flash memory (e.g.,Serial, NAND, NOR, and/or the like), multimedia memory cards (MMC),secure digital (SD) memory cards, SmartMedia cards, CompactFlash (CF)cards, Memory Sticks, and/or the like. Further, a non-volatilecomputer-readable storage medium may also include conductive-bridgingrandom access memory (CBRAM), phase-change random access memory (PRAM),ferroelectric random-access memory (FeRAM), non-volatile random-accessmemory (NVRAM), magnetoresistive random-access memory (MRAM), resistiverandom-access memory (RRAM), Silicon-Oxide-Nitride-Oxide-Silicon memory(SONOS), floating junction gate random access memory (FJG RAM),Millipede memory, racetrack memory, and/or the like.

In one embodiment, a volatile computer-readable storage medium mayinclude random access memory (RAM), dynamic random access memory (DRAM),static random access memory (SRAM), fast page mode dynamic random accessmemory (FPM DRAM), extended data-out dynamic random access memory (EDODRAM), synchronous dynamic random access memory (SDRAM), double datarate synchronous dynamic random access memory (DDR SDRAM), double datarate type two synchronous dynamic random access memory (DDR2 SDRAM),double data rate type three synchronous dynamic random access memory(DDR3 SDRAM), Rambus dynamic random access memory (RDRAM), TwinTransistor RAM (TTRAM), Thyristor RAM (T-RAM), Zero-capacitor (Z-RAM),Rambus in-line memory module (RIMM), dual in-line memory module (DIMM),single in-line memory module (SIMM), video random access memory (VRAM),cache memory (including various levels), flash memory, register memory,and/or the like. It will be appreciated that where embodiments aredescribed to use a computer-readable storage medium, other types ofcomputer-readable storage media may be substituted for or used inaddition to the computer-readable storage media described above.

As should be appreciated, various embodiments of the present inventionmay also be implemented as methods, apparatus, systems, computingdevices, computing entities, and/or the like. As such, embodiments ofthe present invention may take the form of a data structure, apparatus,system, computing device, computing entity, and/or the like executinginstructions stored on a computer-readable storage medium to performcertain steps or operations. Thus, embodiments of the present inventionmay also take the form of an entirely hardware embodiment, an entirelycomputer program product embodiment, and/or an embodiment that comprisescombination of computer program products and hardware performing certainsteps or operations.

Embodiments of the present invention are described below with referenceto block diagrams and flowchart illustrations. Thus, it should beunderstood that each block of the block diagrams and flowchartillustrations may be implemented in the form of a computer programproduct, an entirely hardware embodiment, a combination of hardware andcomputer program products, and/or apparatus, systems, computing devices,computing entities, and/or the like carrying out instructions,operations, steps, and similar words used interchangeably (e.g., theexecutable instructions, instructions for execution, program code,and/or the like) on a computer-readable storage medium for execution.For example, retrieval, loading, and execution of code may be performedsequentially such that one instruction is retrieved, loaded, andexecuted at a time. In some exemplary embodiments, retrieval, loading,and/or execution may be performed in parallel such that multipleinstructions are retrieved, loaded, and/or executed together. Thus, suchembodiments can produce specifically-configured machines performing thesteps or operations specified in the block diagrams and flowchartillustrations. Accordingly, the block diagrams and flowchartillustrations support various combinations of embodiments for performingthe specified instructions, operations, or steps.

IV. EXEMPLARY SYSTEM ARCHITECTURE

FIG. 1 provides an illustration of a system 100 that can be used inconjunction with various embodiments of the present invention. As shownin FIG. 1 , the system 100 may comprise one or more client devices110A-110C, one or more user external server 120, one or morecommunications networks 130, a DSP system 140, and/or the like. Each ofthe components of the system may be in electronic communication with,for example, one another over the same or different wireless or wiredcommunications networks 130. For example, users may access the DSPsystem 140 via communications networks 130 using client devices110A-110C. An external server 120 may interact with the DSP system 140via communications networks 130. Additionally, the DSP system 140 maycomprise a DSP server 150 in communication with at least one DSPgenerating and training repository 160. While FIG. 1 illustrate certainsystem entities as separate, standalone entities, the variousembodiments are not limited to this particular architecture.

The client devices 110A-110C may be any computing device as definedabove. Electronic data received by the DSP server 150 from the clientdevices 110A-110C may be provided in various forms and via variousmethods. For example, the client devices 110A-110C may include desktopcomputers, laptop computers, smartphones, netbooks, tablet computers,wearables, and the like.

The external server 120 may be embodied as a computer or computers asknown in the art. The external server 120 is configured to provide graphdata to the DSP system via communications networks 130. The externalserver operates on a compiled code base or repository that is separateand distinct from that which supports the DSP system. In someembodiments, the external server may communicate with the DSP system,and vice versa, through one or more external application programinterfaces (APIs). In some embodiments, the external server receivestokens or other authentication credentials that are used to facilitatesecure communication between the external server and the DSP system inview of DSP system network security layers or protocols (e.g., networkfirewall protocols). Once connected with the remote networked device,the external server may transmit graph data through the DSP system forgenerating and training a DSP or generating predictive results based onan existing trained DSP.

Communications network(s) 130 may include any wired or wirelesscommunication network including, for example, a wired or wireless localarea network (LAN), personal area network (PAN), metropolitan areanetwork (MAN), wide area network (WAN), or the like, as well as anyhardware, software and/or firmware required to implement it (such as,e.g., network routers, etc.). For example, communications network(s) 130may include a cellular network, an 802.11, 802.16, 802.20, and/or WiMaxnetwork. Further, the communications network(s) 130 may include a publicnetwork, such as the Internet, a private network, such as an intranet,or combinations thereof, and may utilize a variety of networkingprotocols now available or later developed including, but not limited toTCP/IP based networking protocols. For instance, the networking protocolmay be customized to suit the needs of the DSP system. In someembodiments, the protocol is a custom protocol of JSON objects sent viaa Websocket channel. In some embodiments, the protocol is JSON over RPC,JSON over REST/HTTP, and the like.

The DSP server 150 may be embodied as a computer or computers as knownin the art. The DSP server 150 may provide for receiving of electronicdata from various sources, including but not necessarily limited to theclient devices 110A-110C or external server 120. For example, the DSPserver 150 may be operable to receive known/seen graph data provided byclient devices 110A-110C or external server 120, for generating,training, and optimizing a DSP. For another example, the DSP server 150may be operable to receive unknown/unseen graph data provided by clientdevices 110A-110C or external server 120, to generate a predictiveresult associated with the unknown/unseen graph data based on theoptimized DSP.

The DSP generating and training repository 160 may be embodied as a datastorage device such as a Network Attached Storage (NAS) device ordevices, or as a separate database server or servers. The DSP generatingand training repository 160 includes information accessed and stored bythe DSP server 150 to facilitate the operations of the DSP system 140.For example, the DSP generating and training repository 160 may include,without limitation, a plurality of databases storing parametersassociated with each hidden layer, HK, filter, Laplacian operator,and/or the like for constructing a DSP.

a. Exemplary Analytic Computing Entity

FIG. 2 provides a schematic of a DSP server 150 that may be embodied byone or more computing entities according to one embodiment of thepresent invention. In general, the terms computing entity, entity,device, system, and/or similar words used herein interchangeably mayrefer to, for example, one or more computers, computing entities,desktop computers, laptops, distributed systems, items/devices,terminals, servers or server networks, blades, gateways, switches,processing devices, processing entities, set-top boxes, relays, routers,network access points, base stations, the like, and/or any combinationof devices or entities adapted to perform the functions, operations,and/or processes described herein. Such functions, operations, and/orprocesses may include, for example, transmitting, receiving, operatingon, processing, displaying, storing, determining, creating/generating,monitoring, evaluating, comparing, and/or similar terms used hereininterchangeably. In one embodiment, these functions, operations, and/orprocesses can be performed on data, content, information, and/or similarterms used herein interchangeably.

As indicated, in one embodiment, the DSP server 150 may include aprocessor 220, a memory 210, input/output circuitry 230, communicationscircuitry 250, and a DSP generating and training circuitry 240. The DSPserver 150 may be configured to execute the operations described herein.Although the components are described with respect to functionallimitations, it should be understood that the particular implementationsnecessarily include the use of particular hardware. It should also beunderstood that certain of the components described herein may includesimilar or common hardware. For example, two sets of circuitry may bothleverage use of the same processor, network interface, storage medium,or the like to perform their associated functions, such that duplicatehardware is not required for each set of circuitry.

The term “circuitry” should be understood broadly to include hardwareand, in some embodiments, software for configuring the hardware. Forexample, in some embodiments, “circuitry” may include processingcircuitry, storage media, network interfaces, input/output devices, andthe like. In some embodiments, other elements of the DSP server 150 mayprovide or supplement the functionality of particular circuitry. Forexample, the processor 220 may provide processing functionality, thememory 210 may provide storage functionality, the communicationscircuitry 250 may provide network interface functionality, and the like.

In some embodiments, the processor 220 (and/or co-processor or any otherprocessing circuitry assisting or otherwise associated with theprocessor) may be in communication with the memory 210 via a bus forpassing information among components of the apparatus. The memory 210may be non-transitory and may include, for example, one or more volatileand/or non-volatile memories. In other words, for example, the memorymay be an electronic storage device (e.g., a computer readable storagemedium). The memory 210 may be configured to store information, data,content, applications, instructions, or the like, for enabling theapparatus to carry out various functions in accordance with exampleembodiments of the present disclosure.

The processor 220 may be embodied in a number of different ways and mayinclude one or more processing devices configured to performindependently. For example, the processor 220 may be embodied as one ormore complex programmable logic devices (CPLDs), microprocessors,multi-core processors, coprocessing entities, application-specificinstruction-set processors (ASIPs), and/or controllers. Further, theprocessor 220 may be embodied as one or more other processing devices orcircuitry. The term circuitry may refer to an entirely hardwareembodiment or a combination of hardware and computer program products.Thus, the processing element 205 may be embodied as integrated circuits,application specific integrated circuits (ASICs), field programmablegate arrays (FPGAs), programmable logic arrays (PLAs), hardwareaccelerators, other circuitry, and/or the like. Additionally oralternatively, the processor may include one or more processorsconfigured in tandem via a bus to enable independent execution ofinstructions, pipelining, and/or multithreading. The use of the term“processing circuitry” may be understood to include a single coreprocessor, a multi-core processor, multiple processors internal to theapparatus, and/or remote or “cloud” processors.

In an example embodiment, the processor 220 may be configured to executeinstructions stored in the memory 210 or otherwise accessible to theprocessor. Alternatively, or additionally, the processor may beconfigured to execute hard-coded functionality. As such, whetherconfigured by hardware or software methods, or by a combination thereof,the processor may represent an entity (e.g., physically embodied incircuitry) capable of performing operations according to an embodimentof the present disclosure while configured accordingly. Alternatively,as another example, when the processor is embodied as an executor ofsoftware instructions, the instructions may specifically configure theprocessor to perform the algorithms and/or operations described hereinwhen the instructions are executed.

In some embodiments, the DSP server 150 may include input/outputcircuitry 230 that may, in turn, be in communication with processor 220to provide output to the client devices and, in some embodiments, toreceive an indication of a user input via the client devices. Theinput/output circuitry 230 may comprise a user interface and may includea display and may comprise a web user interface, a mobile application, aclient device, a kiosk, or the like. In some embodiments, theinput/output circuitry 230 may also include a keyboard, a mouse, ajoystick, a touch screen, touch areas, soft keys, a microphone, aspeaker, or other input/output mechanisms. The processor and/or userinterface circuitry comprising the processor may be configured tocontrol one or more functions of one or more user interface elementsthrough computer program instructions (e.g., software and/or firmware)stored on a memory accessible to the processor (e.g., memory 210, and/orthe like).

The communications circuitry 250 may be any means such as a device orcircuitry embodied in either hardware or a combination of hardware andsoftware that is configured to receive and/or transmit data from/to anetwork and/or any other device, circuitry, or module in communicationwith the DSP server 150. In this regard, the communications circuitry250 may include, for example, a network interface for enablingcommunications with a wired or wireless communication network. Forexample, the communications circuitry 250 may include one or morenetwork interface cards, antennae, buses, switches, routers, modems, andsupporting hardware and/or software, or any other device suitable forenabling communications via a network. Additionally or alternatively,the communication interface may include the circuitry for interactingwith the antenna(s) to cause transmission of signals via the antenna(s)or to handle receipt of signals received via the antenna(s).

The DSP generating and training circuitry 240 includes hardwareconfigured to support a DSP system. The DSP generating and trainingcircuitry 240 may utilize processing circuitry, such as the processor220, to perform these actions. The DSP generating and training circuitry240 may send and/or receive data from DSP generating and trainingrepository 160. In some implementations, the sent and/or received datamay be parameters associated with each hidden layer, HK, filter,Laplacian operator, and/or the like for constructing and training a DSP.It should also be appreciated that, in some embodiments, the DSPgenerating and training circuitry 240 may include a separate processor,specially configured field programmable gate array (FPGA), orapplication specific interface circuit (ASIC).

As described above and as will be appreciated based on this disclosure,embodiments of the present disclosure may be configured as methods,mobile devices, backend network devices, and the like. Accordingly,embodiments may comprise various means including entirely of hardware orany combination of software and hardware. Furthermore, embodiments maytake the form of a computer program product on at least onenon-transitory computer-readable storage medium having computer-readableprogram instructions (e.g., computer software) embodied in the storagemedium. Any suitable computer-readable storage medium may be utilizedincluding non-transitory hard disks, CD-ROMs, flash memory, opticalstorage devices, or magnetic storage devices.

As will be appreciated, one or more of the DSP server 150's componentsmay be located remotely from other DSP system 140 components, such as ina distributed system. Furthermore, one or more of the components may beaggregated and additional components performing functions describedherein may be included in the DSP system 140. Thus, the DSP system 140can be adapted to accommodate a variety of needs and circumstances.

b. Exemplary User Computing Entity

FIG. 3 provides an illustrative schematic representative of the DSPgenerating and training repository 160 that can be used in conjunctionwith embodiments of the present invention. In one embodiment, the DSPsystem 140 may further include or be in communication with non-volatilemedia (also referred to as non-volatile storage, memory, memory storage,memory circuitry and/or similar terms used herein interchangeably). Inone embodiment, the DSP generating and training repository 160 mayinclude one or more non-volatile storage or memory media, such as harddisks, ROM, PROM, EPROM, EEPROM, flash memory, MMCs, SD memory cards,Memory Sticks, CBRAM, PRAM, FeRAM, RRAM, SONOS, racetrack memory, and/orthe like. As will be recognized, the non-volatile storage or memorymedia may store databases, database instances, database managementsystem entities, data, applications, programs, program modules, scripts,source code, object code, byte code, compiled code, interpreted code,machine code, executable instructions, and/or the like. The terms“database,” “database instance,” “database management system entity,”and/or similar terms used herein interchangeably may refer to astructured collection of records or information/data that is stored in acomputer-readable storage medium, such as via a relational database,hierarchical database, and/or network database.

DSP generating and training repository 160 may also be embodied as adata storage device or devices, as a separate database server orservers, or as a combination of data storage devices and separatedatabase servers. Further, in some embodiments, DSP generating andtraining repository 160 may be embodied as a distributed repository suchthat some of the stored data is stored centrally in a location withinthe system and other data is stored in one or more remote locations.Alternatively, in some embodiments, the distributed repository may bedistributed over a plurality of remote storage locations only. Anexample of the embodiments contemplated herein would include a clouddata storage system maintained by a third party provider and where someor all of the data required for the operation of the system may bestored. As a person of ordinary skill in the art would recognize, thedata required for the operation of the system may also be partiallystored in the cloud data storage system and partially stored in alocally maintained data storage system.

DSP generating and training repository 160 may include informationaccessed and stored by the system to facilitate the operations of thesystem. More specifically, DSP generating and training repository 160may encompass one or more data stores configured to store data usable incertain embodiments. For example, as shown in FIG. 3 , databasesencompassed within the DSP generating and training repository 160 maycomprise an HK database 310, a hidden layer database 320, a DSP database330, an objective function database 340, a training database 350, across-validation database 360, and/or the like.

As illustrated in FIG. 3 , the HK database 310 may comprise Laplacianoperator data including data associated with different Laplacianoperators (e.g., a normalized Laplacian operator or a random walkLaplacian operator) for generating different filters constructing an HK.The HK database 310 may further comprise filter data including selectedfilters (e.g., a K-order Chebyshev filter, a first-order renormalizedfilter, or a K-order topology adaptive filter) for constructing each HK.The HK database 310 may further comprise filter parameter data forgenerating an HK comprising a weighted combination of filters, whereeach filter parameter is associated with a corresponding filter andserved as a weighting value for generating the weighted combination offilters within an HK. The HK database 310 may further comprise filternumber data that records a number of filters selected within each HK inthe machine learning process for optimizing a DSP.

The hidden layer database 320 may comprise HK parameter data forgenerating a hidden layer, where each HK parameter is associated with acorresponding HK and served as a weighting value for generating aweighted combination of HKs within a hidden layer. The hidden layerdatabase 320 may further comprise HK number data that records a numberof HKs selected within each hidden layer in the machine learning processfor optimizing a DSP.

The DSP database 330 may comprise hidden layer number data that recordsa number of hidden layers selected for cascading to generate andoptimize a DSP in the machine learning process.

The objective function database 340 may comprise loss function data andreward function data provided for selection. In the machine learningcontext, a DSP may be optimized by minimizing a loss function based onthe selected loss function data or by maximizing a reward function basedon the selected reward function data.

The training database 350 may comprise training dataset provided forgenerating, training, and optimizing a DSP in a machine learningprocess. The cross-validation database 360 may comprise cross-validationdataset provided for evaluating predictive results of the optimized DSPand determining when to stop the optimization/training process toprevent overfitting the model. The training dataset and thecross-validation dataset may be generated based on splitting aknown/seen graph data. A first portion of the known/seen graph data maybe stored in the training database 350 and a second portion of theknown/seen graph data may be stored in the cross-validation database360.

In one embodiment, the DSP generating and training repository 160 mayfurther include or be in communication with volatile media (alsoreferred to as volatile storage, memory, memory storage, memorycircuitry and/or similar terms used herein interchangeably). In oneembodiment, the volatile storage or memory may also include one or morevolatile storage or the DSP generating and training repository 160 asdescribed above, such as RAM, DRAM, SRAM, FPM DRAM, EDO DRAM, SDRAM, DDRSDRAM, DDR2 SDRAM, DDR3 SDRAM, RDRAM, RIMM, DIMM, SIMM, VRAM, cachememory, register memory, and/or the like. As will be recognized, thevolatile storage or memory media may be used to store at least portionsof the databases, database instances, database management systementities, data, applications, programs, program modules, scripts, sourcecode, object code, byte code, compiled code, interpreted code, machinecode, executable instructions, and/or the like being executed by, forexample, the processing element 308. Thus, the databases, databaseinstances, database management system entities, data, applications,programs, program modules, scripts, source code, object code, byte code,compiled code, interpreted code, machine code, executable instructions,and/or the like may be used to control certain aspects of the operationof the DSP system 140 with the assistance of the processor 220 andoperating system.

c. Exemplary Networks

In one embodiment, any two or more of the illustrative components of thearchitecture of FIG. 1 may be configured to communicate with one anothervia respective communicative couplings to one or more communicationsnetworks 130. The communications networks 130 may include, but are notlimited to, any one or a combination of different types of suitablecommunications networks such as, for example, cable networks, publicnetworks (e.g., the Internet), private networks (e.g., frame-relaynetworks), wireless networks, cellular networks, telephone networks(e.g., a public switched telephone network), or any other suitableprivate and/or public networks. Further, the communications networks 130may have any suitable communication range associated therewith and mayinclude, for example, global networks (e.g., the Internet), MANs, WANs,LANs, or PANs. In addition, the communications networks 130 may includeany type of medium over which network traffic may be carried including,but not limited to, coaxial cable, twisted-pair wire, optical fiber, ahybrid fiber coaxial (HFC) medium, microwave terrestrial transceivers,radio frequency communication mediums, satellite communication mediums,or any combination thereof, as well as a variety of network devices andcomputing platforms provided by network providers or other entities.

V. EXEMPLARY SYSTEM OPERATION

Reference will now be made to FIGS. 4A-8 . FIGS. 4A and 4B illustrateexemplary regular grid datasets received for conducting digital signalprocessing using machine learning. As shown in FIG. 4A, an image datamay be sampled and formulated as two-dimensional (2D) grid data, wherethe Euclidean distance between adjacent sample points (shown as circlepoints in FIG. 4A) is constant. Similarly, as shown in FIG. 4B, audiodata may be sampled and formulated as one-dimensional (1D) grid datahaving a constant Euclidean distance between adjacent sample points.When using machine learning to resolve problems that may be modeled asregular grid data, such as image classification, video recognition, andtext classification, predictive results with better accuracy may bereceived due to the local stationarity of regular grid data. However,some type of problems may not be modeled as regular grid data. ExampleDSPs in accordance with embodiments of the present disclosure may beused to solve machine learning problems in circumstances where thoseproblems can only be modeled as irregular grid data.

FIG. 4C, in contrast, illustrates an exemplary irregular grid graphreceived for conducting digital signal processing using machinelearning. As shown in FIG. 4C, the irregular grid graph data (which, asnoted above, may represent a number of different real-world scenarios,such as a fraud detection network, a recommendation engine network, alife science network (e.g., a disease prediction network), and/or aprovider optimization network) comprises a set of nodes and a set ofedges, where each edge connects two adjacent nodes. The irregular gridgraph data may not only capture features associated with the nodes, butmay also capture features associated with the edges having differentEuclidean distances representing a corresponding relationship betweenany two nodes.

As will be recognized, irregular grid graph data may represent a varietyof other embodiments. For example, irregular grid graph data mayrepresent social networks, telecommunications networks, point clouds,computer networks, protein-interaction networks, knowledge graphs,and/or the like.

FIG. 5 illustrates an exemplary DSP structure generated according to oneembodiment of the present disclosure. As shown in FIG. 5 , when a DSPsystem receives known graph data. In some embodiments, the known graphdata may be derived from an edge/matrix table and a feature filereceived by the DSP. To systematically describe the data structure ofthe known graph data, one may denote the graphset as G=(V, E, A), whereV denotes the set of vertices (i.e., nodes), E is the set of edges, andA is the weighted adjacency matrix of the graph. Assuming there are Lnodes in V the set of vertices can be represented as V=[v₁, . . . ,v_(L)]. Assuming there are T features associated with each node, thefeature matrix, denoted by X, will have dimension L×T. This featurematrix X may be directly loaded from a feature file received by the DSPas set forth above. The weighted adjacency matrix A is derived from anedge matrix/table that defines pairwise connection and weight betweenany two nodes, and that is also received by the DSP, as set forth above.An example transformation from edge matrix/table to adjacency matrix isshown below in Table 1.

TABLE 1 From node To node Weight Node 1 Node 2 Node 3 Node 4 Node 1 Node2 0.8 Node 1 0.8 0.1 Node 1 Node 4 0.1 Node 2 0.8 0.6 0.3 Node 2 Node 30.6

Node 3 0.6 0.7 Node 2 Node 4 0.3 Node 4 0.1 0.3 0.7 Node 3 Node 4 0.7Edge matrix/table Adjacency matrixOne can observe that A is a L×L sparse matrix so that it can behorizontally stacked with X, i.e., [X, A], which may thereafter comprisethe known graph data comprising the input to the DSP. The known graphdata may then be fed into a DSP generating and training model forgenerating an optimized DSP. Once the DSP is optimized, the parametersof the optimized DSP (e.g., the number of hidden layers, the number ofHKs within each hidden layer, and the underlying makeup of each HKwithin each hidden layer) may then be stored into the DSP databasesubsequent utilization.

FIG. 5 further illustrates an exemplary DSP structure proposed forimplementing machine learning on irregular grid graph data. Thedisclosed DSP includes a plurality of hidden layers (as denoted by“Hidden Layer 1,” . . . , to “Hidden Layer L”) that are cascaded onelayer after another. Each hidden layer may include a weightedcombination of a plurality of HKs (as denoted by “HK 1,” “HK 2,” . . . ,to “HK N”). Each HK may further include a weighted combination of aplurality of filters (as denoted by “Filter 1,” “Filter 2,” . . . , to“Filter M”), where each filter may be generated based on differentLaplacian operators as illustrated in FIG. 5 . The disclosed DSP mayhave a special structure utilizing different Laplacian operators forgenerating different filters, which provides prediction results withbetter accuracy by considering different filters at the same time in theoptimization process. The exemplary DSP structure may further include adiscriminant layer which applies discriminant function analysis to finda linear combination of features that characterizes or separates two ormore groups of data, as illustrated in FIG. 5 .

FIG. 6 is a flowchart illustrating operations and processes that may beperformed by a DSP system 140 for generating and training a DSP usingknown irregular grid graph data. As noted previously, the DSP system 140may be embodied by a DSP server 150, which in turn comprises one or moreof a processor 220, memory 210, I/O circuitry 230, communicationscircuitry 250, and DSP generating and training circuitry 240. Atoperation 610, the DSP sever 150 includes means, such as processor 220or the like, for receiving graph data (which may comprise irregular gridgraph data, regular grid graph data, or a combination of the two).

As shown at operation 612, the DSP server 150 may further includesmeans, such as processor 220, DSP generating and training circuitry 240,or the like, for splitting the graph data into a training set of graphdata and a cross-validation set of graph data. In this regard, thetraining dataset may be used for generating an optimized DSP model,while the cross-validation dataset is thereafter used to ensure that anoptimized DSP model has predictive value and/or to determine when tostop iterative training in order to prevent overfitting of the model.Operation 612 is described herein as optional, and when cross-validationis deemed unnecessary, the entirety of the known graph data may serve asthe training dataset, in which case the procedure may advance fromoperation 610 above directly to operation 614 below. In one exampleembodiment, this cross-validation operation adopts exhaustive search,which may help to generate an optimal heterogenous kernel. However, aheterogenous kernel can be also generated from random selection withoutcross-validation (which may not be optimal). Moreover, for some tasks,cross-validation is not required where the problem domain is amenable tooverfitting the whole dataset.

The method 600 continues at operation 614, in which the DSP server 150further includes means, such as processor 220, DSP generating andtraining circuitry 240, or the like, for constructing a set of filtersusing the training set of graph data. The set of filters may include oneor more of a K-order Chebyshev filter, a first-order renormalizedfilter, or a K-order topology adaptive filter, although yet otherfilters may be used in other embodiments. The following provides amethodology for constructing graph filters according to someembodiments. First, as noted above, an adjacency matrix A is derived asexplained previously. Thereafter, the adjacency matrix A is substitutedinto the equations of Laplacian operator L to calculate both normalizedand random-walk Laplacian. As noted previously, the graph filters arethe functions of Laplacian operators. In some embodiments, it isimportant to enumerate both normalized and random-walk Laplacians forall graph filters with different hyperparameters in the cross-validationphase. To this end, any known graph filters can be used here. For easeof explanation, the following is a comprehensive list of all possibleheterogeneous kernels using only two known filters: (a) 1-orderChebyshev filter with random-walk Laplacian & first-order renormalizedfilter with random-walk Laplacian (this filter has no otherhyperparameters); (b) 2-order Chebyshev filter with random-walkLaplacian & first-order renormalized filter with random-walk Laplacian;(c) 3-order Chebyshev filter with random-walk Laplacian & first-orderrenormalized filter with random-walk Laplacian; (d) 1-order Chebyshevfilter with random-walk Laplacian & first-order renormalized filter withnormalized Laplacian; (e) 2-order Chebyshev filter with random-walkLaplacian & first-order renormalized filter with normalized Laplacian;(f) 3-order Chebyshev filter with random-walk Laplacian & first-orderrenormalized filter with normalized Laplacian; (g) 1-order Chebyshevfilter with normalized Laplacian & first-order renormalized filter withrandom-walk Laplacian; (h) 2-order Chebyshev filter with normalizedLaplacian & first-order renormalized filter with random-walk Laplacian;(i) 3-order Chebyshev filter with normalized Laplacian and order-3,first-order renormalized filter with random-walk Laplacian; (j) 1-orderChebyshev filter with normalized Laplacian & first-order renormalizedfilter with normalized Laplacian; (k) 2-order Chebyshev filter withnormalized Laplacian & first-order renormalized filter with normalizedLaplacian; (l) 3-order Chebyshev filter with normalized Laplacian andorder-3, first-order renormalized filter with normalized Laplacian.

Using cross-validation helps to enumerate all possible weightedcombination of these graph filters and hence select the optimal set,which may then be used as the heterogeneous kernel. This heterogeneouskernel mathematically has much larger receptive fields than any of priorarts and hence has superior performance in our experiment. On the otherhand, the weighted combination of graph filter enhances thegeneralization of the model, which may be analogized to ensemble methodsin the conventional machine learning. The filter set may be preexistingin the DSP, such that individual filters are programmed into functionsand then simply retrieved from a memory/local disks by the DSP asappropriate. For instance, when training data comes in, the DESP server150 may use these functions to generate the designed heterogenouskernel.

As shown at operation 616, the DSP server 150 further includes means,such as processor 220, DSP generating and training circuitry 240, or thelike, for determining an objective function for optimizing a DSP model.In some embodiments, the objective function may be a loss function or areward function. The objective function may be selected and served as atargeting goal for optimizing the DSP model. The objective function canbe modelled as objective function=metric(ground truth, predictedresult), where metric(ground truth, predicted result) is the functionwhich measures the difference/similarity between ground truth andpredicted results, e.g., mean squared error (MSE), mean absolute error(MAE), categorical crossentropy, binary crossentropy, Kullback-Leiblerdivergence, or the like. In some embodiments, categorical cross entropymay be selected for multi-class classification tasks, binarycrossentropy may be selected for binary classification tasks, andMSE/MAE may be selected for regression tasks. Moreover, the optimization(minimization/maximization) of the objective function may occur throughthe gradient descent method or its variants.

As shown at operation 618, the DSP server 150 further includes means,such as processor 220, DSP generating and training circuitry 240, or thelike, for initializing the constructed filters. In this regard,initializing the constructed filters may include selecting initialweights for each constructed filter as a whole as well as for variousparameters of each filter.

As shown at operation 620, the DSP server 150 further includes means,such as processor 220, DSP generating and training circuitry 240, or thelike, for generating an optimized DSP using the objective functiondetermined at operation 616, the set of filters constructed at operation614, and the training set of graph data and the cross-validation set ofgraph data split at operation 612. Example sub-steps for generating theoptimized DSP at operation 620 are described in greater detail inconnection with FIG. 7 .

As shown at operation 622, the DSP server 150 further includes means,such as processor 220, communications circuitry 240, or the like, forstoring the parameters defining the optimized DSP in a memory (such asmemory 210). The parameters defining the optimized DSP may comprise aset of data enabling a system (e.g., DSP system 140) to subsequentlyre-create the optimized DSP. For instance, the parameters defining theoptimized DSP may include information defining the discriminant functionof the optimized DSP as well as the number of hidden layers in theoptimized DSP, and the number and structure of each HK in each of thehidden layers of the optimized DSP.

As noted above, following operation 618 in FIG. 6 , the procedure ofFIG. 6 advances to operation 620. One set of example sub-steps that maybe performed at operation 620 are described as follows in connectionwith FIG. 7 , which sets forth a flowchart illustrating a more detailedsequence of operations and processes that may be performed by a DSPsystem 140 for generating an optimized DSP in an iterative manner. Asnoted previously in FIG. 6 , the DSP system 140 may be embodied by a DSPserver 150, which in turn comprises one or more of a processor 220,memory 210, I/O circuitry 230, communications circuitry 250, and DSPgenerating and training circuitry 240. DSP server 150 further includesmeans, such as processor 220 or the like, for generating a set ofheterogeneous kernels (HKs). In this regard, each particular HK may begenerated based on a weighted combination of a corresponding set offilters selected from the constructed set of filters constructed in themanner outlined above in 614. As described in connection with FIG. 5 ,each HK may comprise a corresponding set of filters associated with oneor more initial Laplacian operators and initial filter parameters. TheHK may further be associated with an initial filter number representinga total number of filters in the corresponding set of filters. Eachfilter may further be associated with an initial filter parameterindicating a weighting value used in the weighted combination of the HK.

As shown at operation 715, the DSP server 150 further includes means,such as processor 220 or the like, for generating a set of hiddenlayers, where each hidden layer is generated based on a weightedcombination of a set of HKs, each HK of the set of HKs is associatedwith an initial HK parameter, and wherein each hidden layer isassociated with an initial HK number indicating how many HKs are beingselected to form each hidden layer. In embodiments, a hidden layer maybe initialized based on an initial weighted combination of a set of HKs.The “weight” of each HK comprises an initial HK parameter serving asbaseline parameter in the iterative machine learning process that may bemodified iteratively during the iterative set of operations shown inFIG. 7 .

As shown at operation 720, the DSP server 150 further includes means,such as processor 220 or the like, for generating an initial DSPcomprising a set of hidden layers. The initial DSP further comprises adiscriminant layer that provides discriminant function analysis onoutput produced by the set of hidden layers. For example, thediscriminant layer may formulate a softmax function for multiclassclassification, a sigmoid furcation for binary classification, andlinear activation for regression. For instance, the output of thesoftmax function may be used to represent a categorical probabilitydistribution regarding one target feature over all possible features(e.g., features associated with nodes and edges of the graph data). Foranother example, the discriminant layer may formulate a linearactivation function to solve a regression problem associated with thegraph data. Furthermore, the sigmoid function may be used to classifyoutput data produced by the set of hidden layers in a non-linear andbinary way.

As shown at operation 725, the DSP server 150 further includes means,such as processor 220 or the like, for determining whether the objectivefunction selected in step 616 is optimized. To this end, an empiricalstep in deep learning to understand the convergence of the optimizationof objective function is to observe the learning curve: after theimprovement in first several epochs, if the performance metric oncross-validation set approaches constant stability in the followingseveral epochs, the objective function may be assumed to be converged tooptimal (or local optimal). In circumstances where the objectivefunction is determined to be not optimized, the method 700 continues atoperation 730. If the objective function is optimized, however, themethod advances to operation 620 as described in FIG. 6 .

As shown at operation 730, the DSP server 150 further includes means,such as processor 220 or the like, for updating the one or more initialLaplacian operators, the corresponding initial filter parameters, theinitial filter number, the initial HK parameter, the initial HK number,and/or the initial hidden layer number associated with the initial DSP,and returning back to operation 725 to evaluate whether the updatedversion of the initial DSP is optimized. This iterative loop betweenoperations 725 and 730 may be repeated until the objective function isoptimized. At operation 725, any of the different Laplacian operators,filters, HKs, hidden layers and their associated parameters may bemodified as part of this iterative optimization process. Thus, thedisclosed DSP included in example embodiments described herein mayprovide a predictive results with great precision based on the disclosedmachine learning process. To this end, the cross-validation dataset maybe used to observe the validation performance after each epoch trainingis finished. In a neural network domain, ‘one epoch’ is when an ENTIREdataset is passed forward and backward through the neural network onlyONCE. And to train a neural network model, several epochs are usuallyneeded. However, it is usually not possible to pass an entire datasetinto the neural network at once due to hardware constraints, so there isoften a need to divide a dataset into a number of mini-batches. Then,the number of ‘iterations’ needed to complete each epoch is the numberof mini-batches needed to pass the entire dataset into the neuralnetwork. In this fashion, the size of entire dataset (for 1 epoch oftraining) is equal to the mini-batch size times the number ofiterations. Table 2 provides a simple illustration of observingcross-validation results:

TABLE 2 Epoch 1/10 715442/715442 [===================] − 1456s 2 ms/step− loss: 0.0011 − val_loss: 8.4992e−04 Epoch 2/10 715442/715442[===================] − 1539s 2 ms/step − loss: 8.0923e−04 − val_loss:7.7575e−04 Epoch 3/10 715442/715442 [===================] − 1535s 2ms/step − loss: 7.6253e−04 − val_loss: 7.4941e−04 Epoch 4/10715442/715442 [===================] − 1548s 2 ms/step − loss: 7.3277e−04− val_loss: 7.2124e−04 Epoch 5/10 715442/715442 [===================] −1531s 2 ms/step − loss: 7.0766e−04 − val_loss: 6.9653e−04 Epoch 6/10715442/715442 [===================] − 1547s 2 ms/step − loss: 6.8720e−04− val_loss: 7.2790e−04 Epoch 7/10 715442/715442 [===================] −1544s 2 ms/step − loss: 6.7326e−04 − val_loss: 6.7585e−04 Epoch 8/10715442/715442 [===================] − 1539s 2 ms/step − loss: 6.6213e−04− val_loss: 6.6043e−04 Epoch 9/10 715442/715442 [===================] −1550s 2 ms/step − loss: 6.5229e−04 − val_loss: 6.5040e−04 Epoch 10/10715442/715442 [===================] − 1544s 2 ms/step − loss: 6.4986e−04− val loss: 6.4477e−04As can be seen in Table 2, each ‘step’ refers to each iteration in oneepoch. The cross-validation data set is used to measure to validationperformance (val loss) when each epoch training is finished. And inturn, there may be several epochs needed for training purposes (in theexample shown in Table 2, there are 10 epochs). A special case is wherethe mini-batch size is equal to the size of entire data set, in whichcase one epoch of training will have only one iteration, so that thecross-validation dataset is used when each iteration is completed.

FIG. 8 illustrates an exemplary flow diagram for generating a predictedresult from unknown graph data based on an optimized DSP according toone embodiment of the present disclosure. As with FIGS. 6-7 , theoperations illustrated in FIG. 8 may be performed by a DSP system 140.At operation 810, the DSP server 150 includes means, such as processor220 or the like, for receiving unknown graph data. The unknown graphdata may represent new/unknown data for analysis by an optimized DSPthat is trained to generate a prediction regarding the domain of theunknown graph data.

At operation 815, the DSP server 150 includes means, such as processor220, memory 210, communications circuitry 250, I/O circuitry 230, or thelike, for retrieving the optimized DSP. In some embodiments, anoptimized DSP is at this point generated in the first instance based onthe steps illustrated in FIGS. 6-7 . In other embodiments where anoptimized DSP has been previously generated, the parameters definingthat previously generated DSP are retrieved from a memory and theoptimized DSP is re-created based on those parameters. In yet otherembodiments where an optimized DSP has been previously generated by theprocessor and still persists (e.g., where the optimized DSP alreadyexists), the previously generated optimized DSP may simply be utilized.In any event, as shown by operation 820, the DSP server 150 includesmeans, such as processor 220 or the like, for inputting the unknowngraph data to the optimized DSP. As shown at operation 825, the DSPserver 150 includes means, such as processor 220 or the like, forgenerating, using the optimized DSP, a predicted result based on theinputted unknown graph data. In some embodiments, this predicted resultis generated by inputting the unknown graph data into the optimized DSP,such that the output from the optimized DSP comprises the predictedresult. Based on the output produced by the optimized DSP, conclusionsmay be drawn regarding likely facts about the unknown graph data, andfurther analysis regarding the unknown graph data may be conducted.

Through the generation, training, and use of a DSP system 140 describedherein, example embodiments provide new tools that facilitate accurateand useful predictive evaluation of data represented by irregular gridgraph data. In turn, example embodiments thus unlock new predictivecapabilities in a variety of domains, from improved fraud detection andenhanced recommendation engines to improved tools for evaluating thespread of disease, provider selection, or any of a number of other typesof complicated real-world scenarios.

VI. CONCLUSION

Many modifications and other embodiments of the inventions set forthherein will come to mind to one skilled in the art to which theseinventions pertain having the benefit of the teachings presented in theforegoing descriptions and the associated drawings. Therefore, it is tobe understood that the inventions are not to be limited to the specificembodiments disclosed and that modifications and other embodiments areintended to be included within the scope of the appended claims.Although specific terms are employed herein, they are used in a genericand descriptive sense only and not for purposes of limitation.

1.-20. (canceled)
 21. An apparatus comprising one or more processors and a memory comprising computer-readable instructions, wherein the computer-readable instructions are executable by the one or more processors to cause the apparatus to: receive irregular grid graph data; and generate, using an optimized digital signal processor (DSP), a predicted result based at least in part on the irregular grid graph data, wherein: the optimized DSP comprises a set of hidden layers, a hidden layer of the set of hidden layers comprises a set of heterogeneous kernels (HKs), and an HK of the set of HKs comprises a corresponding set of filters selected from a constructed set of filters and associated with one or more initial Laplacian operators and corresponding initial filter parameters.
 22. The apparatus of claim 21, wherein the irregular grid graph data comprises a set of nodes with one or more node pairs connected by a set of edges in Euclidean space.
 23. The apparatus of claim 22, wherein the set of nodes comprise: (i) a known graph dataset comprising one or more known graph nodes corresponding to one or more known predictions, and (ii) an unknown graph dataset comprising one or more unknown graph nodes without one or more corresponding prediction.
 24. The apparatus of claim 23, wherein the optimized DSP is previously trained using the known graph dataset.
 25. The apparatus of claim 23, wherein the predicted result comprises a machine learning based prediction for an unknown graph node of the unknown graph dataset.
 26. The apparatus of claim 21, wherein the corresponding set of filters comprise: (i) at least one first filter associated with a K-order Chebyshev filter type, (ii) at least one second filter associated with a first order renormalized filter type, and (iii) at least one third filter associated with a K-order topology adaptive filter type.
 27. The apparatus of claim 21, wherein the HK is previously generated based at least in part on a weighted combination of the corresponding set of filters.
 28. The apparatus of claim 21, wherein the hidden layer of the set of hidden layers is previously generated based at least in part on a weighted combination of the set of HKs.
 29. The apparatus of claim 21, wherein the optimized DSP is previously generated by updating the one or more initial Laplacian operators and the corresponding initial filter parameters in an iterative manner to optimize an objective function.
 30. The apparatus of claim 29, wherein the objective function is a loss function.
 31. The apparatus of claim 29, wherein the objective function is a reward function.
 32. The apparatus of claim 21, wherein the optimized DSP further comprises a discriminant layer.
 33. A computer-implemented method comprising: receiving, by one or more processors, irregular grid graph data; and generating, by the one or more processors and using an optimized digital signal processor (DSP), a predicted result based at least in part on the irregular grid graph data, wherein: the optimized DSP comprises a set of hidden layers, a hidden layer of the set of hidden layers comprises a set of heterogeneous kernels (HKs), and an HK of the set of HKs comprises a corresponding set of filters selected from a constructed set of filters and associated with one or more initial Laplacian operators and corresponding initial filter parameters.
 34. The computer-implemented method of claim 33, wherein the corresponding set of filters comprise: (i) at least one first filter associated with a K-order Chebyshev filter type, (ii) at least one second filter associated with a first order renormalized filter type, and (iii) at least one third filter associated with a K-order topology adaptive filter type.
 35. The computer-implemented method of claim 33, wherein the HK is previously generated based at least in part on a weighted combination of the corresponding set of filters.
 36. A non-transitory computer readable medium comprising executable portions configured to: receive irregular grid graph data; and generate, using an optimized digital signal processor (DSP), a predicted result based at least in part on the irregular grid graph data, wherein: the optimized DSP comprises a set of hidden layers, a hidden layer of the set of hidden layers comprises a set of heterogeneous kernels (HKs), and an HK of the set of HKs comprises a corresponding set of filters selected from a constructed set of filters and associated with one or more initial Laplacian operators and corresponding initial filter parameters.
 37. The non-transitory computer readable medium of claim 36, wherein the optimized DSP is previously generated by updating the one or more initial Laplacian operators and the corresponding initial filter parameters in an iterative manner to optimize an objective function.
 38. The non-transitory computer readable medium of claim 37, wherein the objective function is a loss function.
 39. The non-transitory computer readable medium of claim 37, wherein the objective function is a reward function.
 40. The non-transitory computer readable medium of claim 36, wherein the optimized DSP further comprises a discriminant layer. 